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ABSTRACT 

The first step in processing IMS ComSys I data after a teacher tests 
her pupils is the mailing of Criterion Exercises to SWRL's Forms Control 
Center. Although ostensibly a simple step, this document shows that in 
some situations the step added significant amounts of time to the total 
processing turnaround time. Comparisons of the delay days between testing 
and mailing Criterion Exercises are presented between districts^ schools, 
and teachers in an attempt to identify problem areas of warranting further 
consideration in the IMS 1972-73' tryout * / 
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IMS ComSys 1 was implemented in four school districts during the 
1971-72 Tryout. Promptness in mailing Criterion Exercises varied greatly 
among school districts. Table 1 provides summary data for each school 
district and Figure 1 displays the frequency distribution of days-delay 
for each districti Only working days are counted, five days to a week. 
During the first 27 IMS Data Runs 128 mailings of Criterion Exercise 
Units were received from District 1; 65 from District 2;. 22 from District 
'3; and 32 from District 4. Smaller frequencies in the following tables 
account for missing data values. 

The median values provide a better basis for overall comparison 
between districts than the means since the means are more strongly affected 
by single extreme delays. Viewed in decreasing order of median days 
delay, (1) District 4 was worst with a median of 7,0 days defay, followed 
closely by (2) District 3 with-^a median of 6.0 delay days; (3) District 
I's median was 4.0 delay days, while (4) District 2's median was a most 
satisfactory 1.0 days delay. 

Although District I's median is not too extreme, it should be noticed 
that their standard deviation is the greatest among the four school^ 
districts, owing to several extreme values inflating District I's mean 
days delay above District 3's. Thus when ranked by average days delay 
.the districts ordering changes to (1) District 4 (8.0 days delay), (2) 
District 1 (6.6 days delay), (3) District 3 (5.7 days delay), and (4) 
District 2 (1.5 days delay). The extreme delays that largely effect 
the increase of the means over the medians are discussed under "Prompt- 
ness by Teacher". 
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TABLE 1 



■ SUMMARY OF INFORMATION DESCRIBING EACH DISTRICT'S 
DELAY TO MAIL CRITERION EXERCISES 



,SUMMARY DATA FROM RUNS 1-27 


DISTRICT 
1 


DISIRICT 
2 


r\T OTT5 TOT 

'3 


- ! 

4 


Number of Test Units Recorded 




88 


61 


18 • 


28 


Number of. Missing Values 




40 


4 


4 


4 " 


Days Delay 










y - 


Maximum 




35.0 


7.0 


M3.0 ■ 


25.0 


Minitnum ' 




0.0 


0.0 


1.0 


1.0 ; 


R'ange ^ 




35.0 


7.0 


12.0 


24.0 


Median 




4.0 


1.0 ■ 


6.0 


7.0 


Mode 




1 .0 


1.0 


7.0 ; 


7.0 


Mean 




,6.6 


1.5 


5.7 ' 


8.0 


Standard Deviation 


\ 


7.0 


1.5 


3.2 ; 


6.3 ; 


. Standard Error of the Mean 




0.7 


0.2 


0.8 


1.2 ^ 



Eor more detail comparisons between districts, Table 2 gives the 

actual frequency distribution over delay days; Table 3 gives the percent 
\ 

of measurements for each number of days delay, and Table 4 gives the 

\ 

cumulative per cents over days. If over four days is considered unrea- 
sonable delay, it can b.e seen from Table 4 that only 5% of the test units 

received from District 2 were delayed unreasonably; 48% from District 1, 

\ 

67% from District 3, and 72% from District 4. For any other similar 
criterion of promptness, the distri'ct's achievement can be compared 
easily from this table. ^ ^ 
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TABLE 2 


• 




-^"""^ 

1 




DISTRIBUTION OF 


DELAY DAYS BETWEEN TESTING 










. AND MAILING 


OF CRITERION EXERCISES 








Number of 


FREQUENCY OF TEST UNITS BY SCHOOL DISTRICT \ 






Days Delay 


DISTRICT 1 


DISTRICT 2 


1 

DISTRICT 3 


DISTRICT 4 


- 




0 


2 


5 


0 , 


0 






■ 1 


26 


45 


■ 1 


3 


/ \ 




.2 


■ 8 


3 


3 


1 






3 


7 


3 


2 ■ , 


1 




- ' * 


4 




; 2 ' 


0 


3 ■ 






5 
6 


5 " 
2 ' 


0' 


2 
2 


3 

2 ' . " 




; 


7 


■ '4 


3 


4 


5 . ^ 






8 


6 


0 


0 


2 






9 


2 


p 


. 2 


1 


' '\ 




10 


5 


0 


1 


1- 




; ' - - 


11 


1 . 


0 


0 


1 






12 


1 


0 ^ 


? 0 


0 


X 


f 


13 


1 
1 


! 

1 " 


1 








14 • 


2 


i " . 


0 


^ 0 


\ 


- 


15 - 


5 






1 






16 


1 


! 0 


0 


0 


A. 

i 




17 ■ ■ . 


3 


t 

0 


0 


•Q 








f 








\ - 


;erjc 






5 


. 1 

/ 
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Table 2 continued. » . 

0 

A - 



Number of 


FREQUENCY OF TEST UNITS BY SCHOOL 


HT CTPTPT 


j Days Delay 


DISTRICT 1 


DISTRICT 2 


DISTRICT 3 




j u , 


0 


0 


0 


0 


1 19 


0 


0 


0 


1 


! 20 


0 


0 


0 


» 

0 . 


\ 

1 


0 ' 


0 


0 


d 


! 22 


0 


0 ^ 


0 


0 ' 


j, - 


0 


0 


6 


; d ; ; 


I 24 


1 


0 


0 


d' 


1 

25 ■ 


0 


0^ 


-;-,o^ \ 


--2 ; 


t 

; '26 


0 


0 


0 


p 


\ 27 


0 . 


0 ^ 


0 ■ 


0 




2 


0 


0 


0 . -\ 


j 

;■ 29 

* 


0 


0 


0 


■ 0 


» 30 


-V- 'jy 


u 


Q — 


0. 


31 


0 


0 


0 


d 


32 


0 


0 


0 


0 


33 


0 


0 


0 


0 


34 


0 

■ 


0 


0 


0 ^ 


35 


t 


. 0 


0 


0 


Median 

1 


•4.0 


1.0 


6.0 


7.0 



6 





1_4 - - 


^ 
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TABLE 3 






: • 


DISTRIBUTION OF DELAYS DAYS BETWEEN TESTING 








AND MAILING OF CRITERION EXERCISES 




• 


Number of 


PERCENTAGE OF TEST UNITS BY SCHOOL DISTRICT 




Days Delay 


DISTRICT 1 


DISTRICT 2 


DISTRICT 3 


DISTRICT 4 ; 

i 


:_ 


0 


2.37» 


8.27» 


0.0% 


0.0% 1 

i 


t 


1 

i. 


29.5 . 


73.8 


5.6 


10.7 I 






9.1 


4.9 


16.7 


3.6 i 


\ ^ : 


3 


8.0 


4.9 


11.1 ■ 


3.6 


: 




3.4 


. 3/3 


0.0 


10.7 




0 


5.7 
2.3 


0.0 
0.0 


IIM 
11.1 


10.7 
7;1 


= 


7 


4.5 


4.9 


22.2 


17.9 ^ 


; - 


ft 


6.8 ■ 


0.0 


0.0 


7 .1 




Q 


2.3 


0.0 


11.1 


3,6 

' ' 3.6 






5.7 


0.0 


■ 5.6 




11 


1.1 


0.0 


0.0 


3.6 




12 


1.1 


O.'O 


0.0. 


3.6 




13 




0.0 


5.6 


1 

3.6 

1 




14 




0.0 


0.0 


0.0 




15 


14 


0.0 ^ 


0.0 


3.6 




16 


1.1 


0.0 


o,.o 


0.0 

t 




17 


3.4 


0,0 


0.0 


0.0 ! 


• 








'/ 

/ 

/ 

/ 




ERJC 




f 


■ 7 . 







Table 3 continued 



t 










Number of - ^ 


PERCENTAGE OF TEST UNITS BY SCHOOL DISTRICT ' . 


"Days Delay 


DISTRICT 1 


DISTRICT 2 


DISTRICT 3 


DISTRICT A 




- 0.0 


0.0 


0.0 


0.0 


1 Q 


0.0 


0.0 


0.0 


3.6 




'/ 

0.0 


0.0 


0.0 


0.0 




0.0 


0.0 


0.0- 


6.0 ^ 




0.0 


0.0 


0.0 


0.0 




0.0 


0 .0 


■^0.0 


0.0 




1.1 


0.0 


0 .0 


0.0 


t 

ZD 


0.0 


0.0 


0 .0 


7,1 ] 




0.0 


0.0 


0.0 


0.0 




0.0 


0.0 ' 


0.0 


OvO 


Oft 


2.3 


0.0 


. 0.0 ^ 


0.0 


OO 

zy 


0.0 


0.0 


0.0 


0.0 

1 


30 


0.0 


0.0 


0.0 


0.0 


31 


0.0 


0.0 


0.0 


0.0 


32 


0.0 


0.0 


0.0 


0.0 1 


33 


0.0 


0.0 


0.0 


0,0 1 


' - 34 


0.0 


0.0 


0.0 


0.0 ■ 1 


35 


0.0 


0.0 


- 0.0 


0.0 ] 
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TABLE 4 

DISTRIBUTION OF DELAY DAYS BETWEEN TESTING 
AND MAILING OF CRITERION EXERCISES 



Number of 
Days Delay- 



CUMULATIVE PERCENTAGE OF TEST UNITS BY SCHOOL DISTRICT 



DISTRICT 1 



DISTRICT 2 



DISTRICT 3 



DISTRICT 4 



0 
1 
2 
3 
4 
5 
6 
7 
8 
9 

10 
11 
.12 
13 
14 
15 
16 
17 
18 



2.3% 
31.8 
40.9 
48.9 
52.3 
58.0 
60.2 
64.8 ■ 
71.6 
73.9 
79.5 
80.7 
81.8 
83.0 
85.2 
90.0 
92.0 
95.5 
95.5 



8.2% 
73.8 
86.9 
91.8 
95.1, 
95.1 

^noo.o 



0.0% 
22.2 
22.2 
33.3 
33.3 



55.6 



/ 



77.8 
77.8 
88.9 

• ■9474-- 
94.4 
94.4 

*100.0 



0.0% 
•10.7 
14.3 
17.9 
28.6 
39.3 
46.4 
64.3 
71.4 ■ 
75.0 
-78.6 



82.1 
82.1 
85.7 
85.7 
89.3 
89.3 
89.3 
89.3 



9 



8 



I 

Table 4 continued 













Number of 


CUMULATIVE PERCENTAGE OF. TEST UNITS BY SCHOOL DIS,TRICT 


. Delay Days 


DISTRICI 


1 


DISTRICT 2 


DISTRICT 3 


DISTRICT 4 




95.5 • 


■ 




92 V9 


20 


95.5 






92.9 


21 


95>5 


\ 




92.9 \ 


22' 


95,5 




• 


9 2. '9 


23 ■ 


: , 95.5 






: 92.9 ' 


: 24 


96.6 


1 


- 

r 


92-9 


25 


96.6 




[ 

1 




noo.o 

i -; 




96.6 








; \ ; 


27 


96.6 




\ 

z 




\ \ 


^ 28 


98.9' 


1 








^ 29 * 


« 98.9 








H 30 


98.9 , 








31 


—. 98T9-— — 








,32 


98.9 


■ 






33 


98.9 . 


: 






34 


98.0 








35 ' 


*100.0 


- 




V" 



* For each batch of Criterion Exercises for each unit mail§d to SWRL 
through Data Run 27 the test dat^ was subtracted from the postmark 
date to determine days delay. 



-/ 



Promptness of Schools 

To determine the effect of each school's promptness on Che district 

/ 

averages, Tab^Iia 5 compares the average days delay to mail Criterion 
Exercises between schools. The schools are listed within their district 
groupings in descending order of their average, days delay and district 
groups are ordered similarly. 

17.0 was the greatest days delay -among schools, recorded from 
School 404 data. This is over three working weeks. School 402 averaged 



V " 

a delay of two working 



week but less than two 



weeks; eight schools (53%) averaged over one 
and only five schools^ (337o) averaged less than 



a week's Jlelay. Those ^schools averaging less than a week's delay included 
all three schools from District 2,, School 302 District 3, and School 103 
of District 1. 




ERLC 
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TABLE'-5- 



DAYS DEUY TO MAIL CRITER'ION EXERCISES BY SCHOOL 



Ulo i ixXXt i 


AVERAGE DAYS 


STANDARD , 


FREQUENCY OF 


' AND SCHOOL 

_ - ' , 1 


DELAY TO MAIL' 


DEVIATION 


TEST UNITS 


DISTRICT 4 








40^ 

. 402 


17.0 . 


13.9 


' 3 ■ ' 


10.0 


\ 7.0 


2 


■■ y; 

,405 


7.2 \ 
6..5 ^ 


4.8 ; 

1 

2.1 ; 


1 


^01 . 


C C 


\ 1.6. ^ • 6 / 

1 / 


^ r, U • ^ \ 

Combined \ 

:: M ^ 


Q rt/. 
o .Uq 


'6.33 


■28 


DISTRICT 1 




; 


"\\ 


: 102 


7.79 


/ 

/ 7.38 


'■ 48 


101 • 


" 6.16 ' 


■ 7.40 


■ • 25. 

■ 


; \ 103 i 


3.27 


3.33 \ 




Combined 


6.56 


7.00 


88., 


j DISTRICT 3 








S. 3Cl3 


8.67 


5.13 


3 


30]\ V ■ 


6.22 


\ 2.44 


9 


302 \v 


6.00 
3.20 


\ 0.0 
\ 2.17 \ 


1 

5 


CombinedX 


5.77'"' 


\25 

\ 


18 


DISTRICT 2 \ 








X 202 


3.00 


2.94 


10 


203 


^2.00, 


- 1.15 


4 


. / 201 ' 


1.09 


0.65 


.47 


Combined 


1.46 


1.50 


61 " 
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Promptness of Teachers 

Seeking the sources of differences in variability among schools 
suggests looking within schools at the differences amoK^ teachers* The 

teachers are consi_dered below in decreasing order of their school district's 

" , - - — - - c 
•I I 

average days delays: (1) District 4's average days delay by teacher are 
found in Tnble ,6, (2) District IVs in Table 7, (3) District 3's, in Table 
8„ and (4) District 2' s in " 9 . . ' 

The chi-square test indicated a significant difference among the 
average^ays delay record'ed for District 4*s five schools; their averages 
ranged from 5 to 17 days delay. School 404 had the greatest average, 
17.0 days delay, which upon examination is found to be totally attribu- 
table to Teacher 40402. Two of his three mailings were. delayed excessively, 
being over two standard deviations from the district's mean of 8.04 da^c 

i.e. over 20 days! Similarly, School 402's two week average delay was 

' ^ • Y 

found totally attributable to one teacher, /40201 . 

Six of the 9 teachers from School ^03 mailed Criterion Exercises 



with an average of 7. 2. days delay. Averaging over a week's delay were 

\ \ 
Teachers 40303 (14;5 days)., 40301 (9.0 day.s), 40304 .(7,7 days), and 

40305 (6.7 days). Thus two-thirds of* School 403 teachers mailed data 

delayed** over a week in doing so. 

School 405 's average of 6.5 days delay was totally attributable to 

two mailings from Teacher ^0501. School 401 averaged fewer days delay 

than the other District 4 schools, biit his was still over a week being 

weighted by Teach^ir_^0101 averagi;i^ 6.5 days delay and one unidentified 

teacher's mailing of 7.CNdays delay. - 



12 



The^hi-square test for differences- among days delayed by schools 



in District 1 waV also significant. School 102 had the highest average 
in/ the school dli trivet, but note its 7.8 days delay was lower than District 
4'^s average among schools of 8.0 days. Two teachers in School 102 averaged 
delays longer t>ian two weeks and five averaged from one to two weeks,' 
inclusive. They account for 7 tenths of the school's teachers mailing data. 

' ■ 'J 

Teacher 10208' s high standard deviation reflects one of the three ^extremei 

----- / 
delays in the district of two standard deviations from the mean of 6.6/ 

days/ i^/e over 4 weeks. ' , 

^"Teacher 10101 ^'from School 101 averaged three weeks" delay with one 

mailing delayed over four weyeks. Teacher 10105 averaged over two weeks 

,and Teacher 10103 over a week. However, Teacher 10103 was the third source 

of one mailing' delayed over four weeks. All School 103 Teachers averaged 

less, -than one week's delay to mail Criterion Exercises. 

In District 3, School 303 had the longest average delay (8.7 days), 
totally attributable to Teacher 30301; School 302 had the shortest average 
delay (3.2 days), totally attributable to Teacher 30201.^ Both teachers 
mailing data from School 301 averaged over a week's delay as did Teacher 
30404 in the sole majLling from.- School 304. 

All teachers in District 2 averaged less than four days delay, with 
only three of their 61 recorded mailings delayed over 4 days. Their | 
performance need not be elaborated upon, as it appears entirely satisfactory, 

It would be interest/ng to compare attitude data obtained from the 
debriefing sessions with /the above to determine whether and/or what dis- 
satisfaction rested with those who substantially delayed processing of 
their own data. 
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TABLE 6 



DELAY DAYS BETOEEN TESTING AND MAILING CRITERION EXERCISES 





\ 


IINTTQ ■ 


AMflNn TFAPHFRS 


IN DTSTRTCT 4 






SCHOOL 


y 


\ 

FREQUENCY 
OF MAILINGS 


AVERAGE DAYS 
DELAY TO MAIL 


( ^ 

STANDARD j 
DEVIATION 

1 












— 1 




School 404 








1 
1 




40402 




3 


17.0 


13.9 




' 40401 


' V 


0 


- 






40403 




0 








40404 ' 




0 




I 

\ 




40405 




0 








40406 




0 




/ 




Combined 




- J 








School 402 












■40201 




2 


10.0 


7.0 




40202 




0 






■ 


Combined 




2 


10.0 


7.0 




School hUJ 






\ 




: 

: 






2 


14.5 


6.4 


1 
1 


40301 




1 


9.0 


0.0 




40304 




0 




2.9 , 


I 
1 


40305 




3 


6.7 


3.8 i 




40306 




2 


1.5 


0.7. '1 




40308 




1 


1.1 


0.0 i 

1 


i 

( 


40302 




0 








40307 




0 




i 




40309 ' 




0 


— -V 






Combined 




15 


\ 7.2 - 


4.8 



15 



14 



Qr»hnn1 AOS 

\ 


2 




2.1 


40502 


• 0 






Combined. ■ 


2 


6.5 


i. . J. 


■ School 401 








40101 


2 


6.5 


0.7 


40103- ^ 
40102 


2 

1 


4.5 
4.0 ■ 


2.1 
0.0 


Unidentified 


1 


7.0 


0.0 


Combined 


6 

^ 


5.5 


1.6 



f 



/ 
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TABLE 7 

DEIAY DAYS BETt'TEEN TESTING AND MAILING 
CRITERION EXERCISE UNITS AMONG^ TEACHERS 
IN DISTRICT 1 



ot»nUUL 




1 ■ T 

\ 

AVERAGE 


STANDARD i 


AND TEACHER 


MAILINGS 


DAYS DELAY 


n I7\7T A TT AM 1 




School 102 




; 






10205 


6 


13.0 


A 1 




10210 


2 


12.0 


2.8 




10?16 


9 


10.0 


8.2 




10204 


.7 


8.7 


5.3 




10208 


* 

7 


7.1 


12.5 




10206 


6 " 


6.7 


6.6 




" 10201 


1 


5.0 


0,0 




10207 


3 


4.3 


■ 4.9 




10209 


5 


2.2 


1.6 




10202 


2 


1.0 . 


0.0 




10203 


0 


- 




1 


10212 


0 








10214 


0 


- 




I 

i 


10215 


0 




1 


Combined 


48 


7.8 


7.4 


School -101 








10101 


3 


15.0 


11.4 


10105 • 


, 3 


10.3 


i 2.1 . 


10103 


4 


8.5 


\ 13.0 


10104 


2 


3.0 


0.0 


i 10102 

T 


9 


2.8 


2.5 


I 10106 


. 2 


2.5 


\ 0.7 


' Unidentifed 




4.0 


4.2 


Combined 


25 ' • 


6.2 


7.4 



17 



/ 



16 



Table 7 continued 



\ 



\/ / 



School 103 

10301 
• 10303 

10302 



Combined 



8 

1 
5 

15 



4.1 
-2.0 
1.4 

3.3 



4.1 
0.0 
0.5 

3.3 



\ 



/ 



18 



17 



TABLE 8 

D^LAY DAYS BETWEEN TESTING AND MAILING CRITERION 
EXERCISE UNITS AMONG -TEACHERS IN DISTRICT 3 



SCHOOL ■ \ 
* AND TEACHER \ 


FREQUENCY 
OF MAILINGS 


AVERAGE DAYS 
DELAY TO MAIL 


STANDARD \ 
DEVIATION j 


School 303 
30301 ' 




. 3 ' 


1 

\ 

8.7 


* 

5.1 


^ School 301 
30i01 
30104 
30102 
30103 




4 

' 5 
. 0 
0 


\. 

5.6- 

1 


0.0 

\ 3.3^ 


Comb iried 




9 


6.2 . 


2.4 



School 304 



30404 
30501 
30402 
30403 
30405 
30406 



Combined 
School 302 



30201 



1 
0 
0 
0 

0 
0 



6.0 



6.0 



8.7 



0.0 



0.0 
5. 1 



\ 



\ 



19 



/ 



I ■ - 

TABLE 10 

DELAY DAYS BETWEEN TESTING AND MAILING CRITERION 
EXERCISE UNITS AMONG TEACHER IN DISTRICT. 2 



SCHOOL . 


-FREQUENCY 


AVERAGE 




AND TEACHER 


OF MAILINGS 


DAYS DELAY 


DEVIATION 


School 202 




1 
I 




20201 


8 


3.5 


3.1 


20202 


2 


1.0 


0.0 


20203 


0 




._ 


Combined 


10 


3.0 


2.9 


School 203 








20303 


2 


3.0 


n n 
0 .0 


20305 , ^ 


2 




U .u 


•20302 


0 






20301 


0 






20304 


0 





— 


Combined 


4 


2.0 


1.2 


Cr'HnnI 901 
OCnUUX ^v/J. 






- 


. .20iq4 


4 


2.0 


1.6 


20106 




. 1.0 


0.6 


20107 


■ -i: 


1.6 


0.0 


20108 


16 


1.0 


0,6 


20109 


6 


1.0 


0.0 


20101 


0 




M 


20102 


0 






, 20105 


0 


: / 




20110 


0 


/ 




\ ■ Combined 


47 ■ 


1.1 


0.7 




FRKQUENCY DISTRIBUTION OF 



TEACHERS' DELAY TO MAIL CRITERION EXERCISES 




■« ' .- 
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\ 



/ 

/ 



1 
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